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(54) PICTURE PROCESSING DEVICE, PICTURE PROCESSING METHOD, GAME DEVICE USING 
SAME, AND MEMORY MEDIUM 

(57) An object of this invention is to provide an 
image processing device which does not interrupt the 
flow of a game. 

The processing board in the main game device 
attaches information required by the player at the com- 
pletion of each stage to a map and provides it to the 
player by displaying it on the display in the following way. 
The front edge of the truck 20 is displayed (Fig. 5(a)), 
and camera work is conducted showing the game char- 
acters 24, 25 riding in the truck 20 (Fig. 5(b)). In order 
that the relationship between the characters 24, 25 and 
the truck 20 can be appreciated, a bird's-eye view is 
shown on the display 1a (Fig. 5(c)), and the camera 
work is moved again to diagonally above the characters 
24, 25, and an enlarged display of the characters 24, 25 
is shown (Fig. 5(d)). The map 26 is displayed such that 
it can be viewed from between the characters 24, 25 
(Fig. 5(e)), and finally, the map 26 is displayed as an 

enlarged image (Fig. 5(f)). ( e ) 
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Description 

TECHNICAL FIELD 

The present invention relates to an image process- 
ing device, an image processing method and a game 
device using the same. More particularly, it relates to an 
image processing device, and the like, for a game 
machine, or the like, using computer graphics. Further- 
more, it also relates to a storage medium whereby these 
processing steps are stored. 

BACKGROUND ART 

With the progress ol computer graphics technology 
in recent years, data processing devices, such as game 
devices or simulation devices, have come into wide, 
general use. Game devices, for example, are provided 
with peripherals, such as a joystick (operating lever), 
buttons, a monitor, and the like, a main game device 
which conducts data communications with these periph- 
erals, as well as image processing, sound processing, 
and the like, and a display which displays image signals 
produced by this main device. The image processing in 
such game devices is of particularly great importance in 
raising product value, and therefore image reproduction 
technology has become increasingly refined in recent 
years. 

One known example of a game device of this kind is 
"Title Fight" (trademark). In this game, the characters 
(combatants) are composed by sprites (single-layer pic- 
tures), and the background and the like is composed by 
a scrolling screen. 

However, by this means, it is not possible to change 
the viewpoint and represent the characters three- 
dimensionally. Therefore, in recent years, it has been 
sought to compose three-dimensional shapes by a plu- 
rality of polygons, and to map texture (pattern) onto 
these polygons and display characters viewed from any 
viewpoint. 

Known examples of this are TV game devices 
which depict three-dimensional characters by means of 
texture-mapped polygon data, and depict background 
sections, where movement is required in accordance 
with movement of the characters or change in the view- 
point, by means of textured polygon data also, (for 
example, Sega Enterprises (Co. Ltd.) "Rail Chase I".) 

Thereby, rather than composing characters using 
sprites, the characters, and the background and the like 
closely related to the movements of the characters, can 
be represented as three-dimensional images viewed 
from prescribed viewpoints. 

Incidentally, in a conventional TV game device as 
described above (for example, Sega Enterprises (Co. 
Ltd.) "Rail Chase I"), when one stage of the game is 
completed, the hero characters look at a map and move 
to the next stage. For this purpose, in this device, the 
map is formed by separate scroll data, and at the 
moment one stage has finished, the screen suddenly 



switches to displaying a map, without any connection to 
the game environment (First prior art example). 

Furthermore, in this device, there is a scene where 
the hero characters move by riding in a truck, and in this 

5 case, the camera work based on the heroes' viewpoint 
is determined by the direction of movement of the truck. 
For example, as shown in Fig. 22 (a), il the direction 
changes at points ql, q2, q3, q4, at point ql, the 
coordinates of point q2 are read in advance and the 

io viewpoint of the hero characters at point q1 is set in the 
form of coordinates (X, Y, Z, A) (where A is an angle). In 
this way, the camera work at the viewpoint of the hero 
characters as the truck 220 moves to each point q1 , q2, 
q3, q4, ... is as shown in Fig. 22(b). Specifically, at point 

75 q1. for example, it is set as coordinates (X, Y, Z, A) and 
at point q3, for example, it is set as coordinates (X, Y, Z, 
B) (where B is an angle). 

Here, as shown in Fig. 23, the camera direction is 
labelled E, the camera orientation is labelled F, and the 

20 field of view is labelled G. Thereby, as shown in Fig. 24, 
before reaching point q1 1 , the camera orientation is F1 
and the field of view is G1 , after passing point q1 1 and 
before reaching point q12, the camera orientation is F2 
and the field of view is G2, and after passing point q12 

25 and before reaching point q1 3, the camera orientation is 
F3 and the field of view is G3, ... and in this way, 
switches in direction occur at individual points, resulting 
in large changes in the field of view G (Second prior art 
example). 

30 Moreover, in this device, a river is displayed as a 
background, or the like. Texture-mapped polygons are 
used to represent the flow of water in this river, a texture 
with the appearance of water being applied to the poly- 
gons along the flow of the river, and these texture coor- 

35 dinates being changed over time in accordance with the 
direction of the water flow. For example, as shown in 
Fig. 25, if texture coordinates are projected onto the pol- 
ygons 150, 150, ... about a desired axis, they are dis- 
played such that they move in the same direction as all 

40 the polygons 150, 150 Furthermore, as shown in 

Fig. 26, if each of the four corners of the polygons 151, 
152, 153, 154, 155, 156 is made to correspond to a fac- 
tor n of the texture, then it is possible to achieve the rep- 
resentation of a winding river flow, according to the 

45 shape of each polygon 151, 152, 153, 154, 155, 156 
(Third prior art example). 

Additionally, in this device, if Z-buffering, which is a 
technique for erasing hidden surfaces, is used in gener- 
ating a particular screen, as shown in Fig. 27(a), when 

so looking from viewpoint 210 at a background 220 in the 
infinite distance, an object in the far distance, or an 
object 221 having no distance value, the screen has the 
display range 230 (Fourth prior art example). 

Furthermore, since there is a limit on the maximum 

55 number of polygons that can be displayed simultane- 
ously using this device, the number of polygons dis- 
played is controlled such that the polygons on the whole 
screen do not exceed the maximum number (Fifth prior 
art example). 



2 



3 



EP0 782 104 A1 



4 



Incidentally, according to the first prior art described 
above, there has been a drawback in that the flow of the 
game is interrupted because a map created separately 
from the game environment is introduced into the game 
environment. In other words, there has been a draw- 
back in that, since the viewpoint is usually from within 
the game, if separate contents are suddenly displayed, 
this completely disrupts the flow of the game and con- 
fuses the player. 

Furthermore, according to the second prior art 
described above, there has been a drawback in that, as 
shown in Fig. 22 and Fig. 24. at each point q.n (where n 
is an integer), the camera orientation F is determined by 
reading the coordinates of the next point, q.n + 1, in 
advance, and hence the viewpoint swings by a large 
amount because the direction is switched at individual 
points, and it is hard to create an awareness of the sur- 
rounding circumstances. In particular, in curves, dead 
angles occur more frequently than in reality. 

Moreover, according to the third prior art described 
above, when texture coordinates are projected onto the 
polygons in the image shown in Fig. 25, the projected 
surfaces are texture-mapped at a uniform density, but 
there has been a drawback in that, even if the texture 
coordinates are moved, they all move in a single direc- 
tion only, and therefore it is not possible to represent a 
winding river, for example. Furthermore, in the image 
shown in Fig. 26. although the texture is made to corre- 
spond to the polygons and therefore it can be repre- 
sented as flowing in a direction corresponding to the 
shape of the polygons and it can represent the flow of a 
winding river, there has been a drawback in that the tex- 
ture density is represented in an altered (compressed) 
state at changes in the river width, sharp curves, or the 
like. 

In addition, in the fourth prior art described above, 
three-dimensional computer graphics are used and for 
this technique, Z-buffering or Z-sorting is often used to 
display the corresponding image. At present, due to 
demands for increased speed in processing, in some 
cases, the Z-buffer (depth information for an object) may 
be recorded in integer values, or the coordinate values 
calculated as integers (using a fixed decimal point). 
Therefore, special processing is conducted if the depth 
of an object at an infinite distance is to be represented. 
Moreover, if limits are placed on the display range in the 
depth direction in order to ensure accuracy when using 
Z-buffering, then it is necessary to locate the object at a 
distance that comes within this display range 230. Spe- 
cifically, as shown in Fig. 27(a), the object 221 must be 
positioned such that it comes within the display range 
230. As a result, there is a drawback in that, if the view- 
point 21 0 moves towards the left side of the diagram, for 
example, although the background 220 in the infinite 
distance moves, the object 221 at a far distance (or an 
object having no distance value) does not move, and 
therefore the appearance will change. 

Yet further, according to the fifth prior art described 
above, the total number of polygons on the whole 



screen is limited. However, there are cases where the 
game screen is constituted by polygons representing 
the background and polygons representing enemies, 
and the like, and in particular, there are cases where the 

5 enemies increase in number as the game progresses. 
Therefore, in order to represent the enemies, the 
number of polygons for the background is restricted, 
and in some cases, a part of the background image is 
lost (so-called polygon error). This loss of the back- 

70 ground image causes a marked impairment in the qual- 
ity of the game image. 

In short, there has been the problem that effective 
image processing cannot be achieved in conventional 
image processing devices, such as game devices of this 

75 type. 

Therefore, this invention was made in order to over- 
come these problems. 

A first object of this invention is to provide an image 
processing device which does not interrupt the flow of a 
20 game. 

A second object of this invention is to provide an 
image processing device capable of moving a viewpoint 
in a natural state. 

A third object of this invention is to provide an image 
25 processing device capable of displaying natural move- 
ment. 

A fourth object of this invention is to provide an 
image processing device comprised such that, even if 
the viewpoint moves, a screen in the far distance will 
30 appear in a similar state to a natural state. 

A fifth object of this invention is to provide an image 
processing device capable of preventing loss of back- 
ground images. 

35 DISCLOSURE OF THE INVENTION 

In an image processing device which causes a 
moving object composed in three-dimensional spatial 
coordinates to move, and generates viewpoint images 
40 whereby the moving object is viewed from prescribed 
viewpoints. 

this invention comprises information represent- 
ing object generating means for composing an informa- 
tion representing object whereby information relating to 

45 the moving object is represented. 

The information representing object generating 
means of this invention composes a planar object por- 
traying the position of the moving object as the informa- 
tion representing object. 

so The information representing object generating 
means of this invention causes the planar object to 
change from a folded state to an opened state. 

This invention comprises viewpoint moving means 
for moving the viewpoint such that, when an information 

55 representing object has been composed, both the mov- 
ing object and the information representing object are 
displayed. 

The viewpoint moving means of this invention, 
moreover, moves the viewpoint towards the information 
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representing object. 

This invention, moreover, comprises display means 
for displaying the generated viewpoint image. 

This invention is a game device which conducts a 
game whilst causing the moving object to move in three- s 
dimensional spatial coordinates, and it comprises any of 
the image processing devices described above. 

In an image processing method which generates 
viewpoint images whereby a moving object composed 
in three-dimensional spatial coordinates and an infor- io 
mation representing object which represents informa- 
tion relating to this moving object are viewed from 
prescribed viewpoints, 

this invention comprises: 

75 

a first step whereby the viewpoint is moved to a 
position displaying the moving object only; 
a second step whereby the viewpoint is moved to a 
position displaying both the moving object and the 
information representing object; and so 
a third step whereby the viewpoint is moved 
towards the information representing object such 
that the information representing object is displayed 
as a large image. 

25 

According to this invention, since image processing 
is conducted whereby an information representing 
object such as a planar object or the like, is displayed in 
three-dimensional spatial coordinates in relation to the 
moving display object, the planar object on which the so 
necessary information is written can be viewed without 
an unnatural impression being created, and it can be 
linked smoothly to the subsequent images. Further- 
more, according to this invention, image processing 
which is advantageous to game development becomes 35 
possible. 

Moreover, according to this invention, since the 
viewpoint is controlled such that it moves towards the 
planar object, the display of the planar object (for exam- 
ple, a map) can be enlarged gradually and the player 40 
can be provided with a space through which he or she 
can actually look at the map on the game screen. 

Furthermore, in this invention, since image 
processing is conducted whereby a planar object is dis- 
played from a folded state to an opened state, it is pos- 45 
sible to achieve a device which creates an impression 
that approximates reality. 

This invention comprises view axis determining 
means for determining the view axis direction on the 
basis of a moving object composed in three-dimen- so 
sional spatial coordinates, a observation point located 
on the path through which the moving object is to pass 
subsequently, a transit point located on the path through 
which the moving object has already passed, and posi- 
tional information for the observation point and posi- ss 
tional information for the transit point. 

The view axis determining means of this invention 
determines the view axis direction on the basis of posi- 
tional information for a observation point and a transit 



point located equidistantly in front of and behind the 
moving object. 

If the moving object moves along a curve, the view- 
point determining means of this invention changes the 
distance from the moving object to the observation point 
and the transit point, respectively, in accordance with 
the properties of the curve. 

This invention comprises display means for display- 
ing the generated viewpoint image. 

This invention is a game device which conducts a 
game whilst causing the moving object to move in three- 
dimensional spatial coordinates, and it comprises any of 
the image processing devices described above. 

In an image processing device which causes a 
moving object composed in three-dimensional spatial 
coordinates to move, and generates viewpoint images 
whereby the moving object is viewed from prescribed 
viewpoints, 

this invention comprises viewpoint determining 
means for smoothly changing the line of sight centerd 
on the viewpoint in accordance with the path of the mov- 
ing object. 

The fact that it smoothly changes the line of sight in 
accordance with the path of the moving object means 
that it continuously changes the line of sight, in all sec- 
tions or at least in a portion thereof, on the basis of the 
properties, for example, the curvature, tangential vec- 
tors, differential coefficients, and the like, of a predeter- 
mined path or a path based on the results of movement 
of the moving object. 

The viewpoint determining means of this invention 
determines the direction of the line of sight centerd on 
the viewpoint, on the basis of coordinates on the path in 
front of and behind the moving object. 

The viewpoint determining means of this invention 
calculates two sets of coordinates located equidistantly 
in front of and behind the moving object, and takes the 
straight line joining these coordinates as the direction of 
the line of sight. 

If the moving object moves along a curve, the view- 
point determining means of this invention changes the 
distance from the moving object to the coordinates in 
front of and behind it, respectively, in accordance with 
the properties of the curve. 

This invention, moreover, comprises display means 
for displaying the generated viewpoint image. 

This invention is a game device which conducts a 
game whilst causing the moving object to move in three- 
dimensional spatial coordinates, and it comprises any of 
the image processing devices described above. 

In an image processing method which causes a 
moving object composed in three-dimensional spatial 
coordinates to move, and generates viewpoint images 
seen from the viewpoint of the moving object, 
this invention comprises: 

a first step whereby the position of the moving 
object is read; 

a second step whereby a first point is set on the 
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path to the front of the moving object at a predeter- 
mined distance from the position thereol; 
a third step whereby a second point is set on the 
path to the rear of the moving object at a predeter- 
mined distance from the position thereof; and 
a fourth step whereby the direction of the line of 
sight from the viewpoint is determined by the line 
joining the first point and second point. 

According to this invention, when the moving dis- 
play object is in a state of travel in a prescribed direc- 
tion, since at least one set of coordinates in front of or 
behind the current coordinates of the moving display 
object are input and the direction of the viewpoint is 
determined on the basis of these coordinates, the 
movement of the viewpoint approximates movement of 
the viewpoint in reality, and a device capable of a more 
natural representation can be achieved. In addition, 
image processing that is advantageous to game devel- 
opment also becomes possible. 

Furthermore, in this invention, since coordinates 
located equidistantly in front of and behind the current 
coordinates of the moving display object are introduced, 
and the direction resulting when the coordinates of 
these two points are joined by a straight line is taken as 
the direction of the viewpoint, the movement of the view- 
point approximates movement of the viewpoint in reality. 

Moreover, in this invention, when the moving dis- 
play object is moving along a curve, since the distance 
between the current coordinates of the moving display 
object and the introduced coordinates in front of and 
behind it are changed in accordance with the curvature 
of this curve, it is possible to achieve more realistic 
movement of the viewpoint. 

In an image processing device which generates 
prescribed images by applying texture respectively to 
linked pluralities of polygons, 

this invention comprises coordinate processing 
means for determining a reference vector for each 
mutually linked plurality of polygons and for causing the 
texture to move in the direction of the reference vector, 
the moved texture being applied to the polygons. 

In an image processing device which generates 
prescribed images by applying texture respectively to 
linked pluralities of polygons, 

this invention comprises coordinate processing 
means for determining a reference vector for each lon- 
gitudinal or lateral polygon chain in the longitudinally 
and laterally linked pluralities of polygons, and for caus- 
ing the texture to move in the direction of this reference 
vector, without any deformation of the texture. 

The coordinate processing means of this invention 
determines the reference vectors on the basis of a pre- 
determined curve. 

In this invention, the reference vectors for each of 
the pluralities of polygons are continuous and the tex- 
ture corresponds to a flow along the curve. 

This invention, moreover, comprises display means 
for displaying the generated image. 



In an information processing method which gener- 
ates prescribed images by applying texture respectively 
to linked pluralities of polygons, 
this invention comprises: 

5 

a first step whereby a reference vector is deter- 
mined for each mutually linked plurality of polygons; 
a second step whereby the texture is caused to 
move in the direction of the reference vector; and 
w a third step whereby the moved texture is applied to 
the polygons. 

According to this invention, for longitudinally and 
laterally linked pluralities of polygons, a vector acting as 
75 a reference is assigned to each polygon chain in the 
longitudinal or lateral direction, and the texture is 
caused to move in the direction of this reference vector, 
without any deformation of the texture. Consequently, it 
is possible to achieve a more realistic representation of, 
20 for example, a screen on which there is a flowing image, 
such as the flow of water in a river. 

Furthermore, in this invention, since the line seg- 
ments forming the references are defined on the basis 
of a predetermined curve (for example, the path of a 
25 river), there is no alteration in the density of the texture, 
and a natural flow can be represented. 

In an image processing device which causes a 
moving object to move in three-dimensional spatial 
coordinates, and generates viewpoint images seen 
30 from a viewpoint at the position of this moving object, 
this invention comprises movement processing 
means for causing a background image representing 
the distant background to move with the movement of 
the viewpoint. 

35 In this invention, the background image forms a 
cylindrical shape or a spherical shape. 

This invention, moreover, comprises display means 
for displaying the generated image. 

This invention is a game device which conducts a 
40 game whilst causing the moving object to move in three- 
dimensional spatial coordinates, and it comprises any of 
the image processing devices described above. 

In an image processing method which causes a 
moving object to move in three-dimensional spatial 
45 coordinates, and generates viewpoint images seen 
from a viewpoint at the position of this moving object, 
this invention comprises: 

a first step whereby the amount of movement of the 
so moving object is found; and 

a second step whereby a background image repre- 
senting the distant background is caused to move 
on the basis of this amount of movement. 

65 In this invention, since a prescribed screen is 
caused to move in accordance with the movement of 
the viewpoint, even if the viewpoint moves, objects or 
the like which are at infinite distances, or have no dis- 
tance relationship, can be displayed accurately, and 
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therefore a more realistic representation can be 
achieved. Furthermore, image processing which is 
advantageous to game development becomes possible. 

Moreover, in the present invention, the prescribed 
screen is located in a cylindrical or spherical position, 
the viewpoint is located at the center thereof, and the 
center in question can be moved with the movement of 
the viewpoint, and therefore objects or the like which are 
at infinite distances, or have no distance relationship, 
can be displayed accurately. 

In an image processing device which causes a 
moving object composed in three-dimensional spatial 
coordinates to move, and generates viewpoint images 
seen from a viewpoint at the position of this moving 
object using polygons, 

this invention comprises polygon number con- 
trolling means for classifying the polygons forming the 
viewpoint image into a plurality of groups, and for con- 
trolling the number of polygons displayed such that, at 
each group, it is at or below a predetermined maximum 
number of polygons displayed. 

The polygon number controlling means of this 
invention classifies the polygons forming the viewpoint 
image into at least a group representing the background 
and a other group. 

This invention, moreover, comprises display means 
for displaying the generated viewpoint image. 

This invention is a game device which conducts a 
game whilst causing the moving object to move in three- 
dimensional spatial coordinates, and it comprises any of 
the image processing devices described above. 

In an image processing method which causes a 
moving object composed in three-dimensional spatial 
coordinates to move, and generates viewpoint images 
seen from a viewpoint at the position of this moving 
object using polygons, 

this invention comprises: 

a first step whereby the polygon forming the view- 
point image is classified into a plurality of groups 
and a maximum number for the number of polygons 
displayed is determined at each group; and 
a second step whereby the number of polygons dis- 
played is controlled at each group within a range 
not exceeding the maximum display number. 

According to this invention, other screens apart 
from the moving display object are classified into a plu- 
rality of types, the number of polygons allocated to each 
screen is restricted independently, and each screen is 
composed within the corresponding restriction. Conse- 
quently, for example, even in a case where a large 
number of enemies appear, there is no loss of polygons 
in the background image. 

In an image processing device which causes a 
moving object composed in three-dimensional spatial 
coordinates to move, and generates viewpoint images 
seen from a viewpoint at the position of this moving 
object, 



this invention comprises field of view changing 
means for changing the field of view of the viewpoint 
image in accordance with the conditions in the direction 
of movement. 

5 The field of view changing means of this invention 

broadens the field of view when no object is present in 
front of the moving object, and narrows the field of view 
when an object is present. 

This invention, moreover, comprises display means 

io for displaying the generated viewpoint image. 

This invention is a game device which conducts a 
game whilst causing the moving object to move in three- 
dimensional spatial coordinates, and it comprises any of 
the image processing devices described above. 

75 In an image processing method which causes a 
moving object composed in three-dimensional spatial 
coordinates to move, and generates viewpoint images 
seen from a viewpoint at the position of this moving 
object, 

20 this invention comprises: 

a first step whereby conditions relating to objects in 
front of the moving object are investigated; and 
a second step whereby the field of view is broad- 
25 ened when no object is present, and the field of 
view is narrowed when an object is present. 

According to this invention, since the field of view is 
changed in response to conditions in front of the moving 

30 object, a natural image can be obtained. For example, if 
the truck on which the character is riding is travelling 
across a plain, then a sensation of wide open space can 
be created by broadening the field of view, whilst rf it is 
travelling through a tunnel, then an enclosed sensation 

35 can be created by narrowing the field of view. Further- 
more, if it is travelling along a city street, for example, 
then this falls midway between the two cases above and 
an intermediate field of view is selected, thereby creat- 
ing a sense of presence and a sense of speed. 

40 This invention is a storage medium wherein the pro- 
cedures for implementing any of the methods described 
above are recorded. This storage medium may com- 
prise, for example, a floppy disk, magnetic tape, pho- 
tomagnetic disk. CD-ROM, DVD, ROM cartridge, a 

45 cartridge fitted with a RAM or flash memory with battery 
back-up, a fixed RAM cartridge, or the like. A storage 
medium is a device wherein information (principally, dig- 
ital data or programs,) is recorded by some physical 
means, and it is capable of implementing prescribed 

so functions in a processing device such as a computer, 
special processor, or the like. 

BRIEF DESCRIPTION OF THE DRAWINGS 

55 Fig. 1 is an oblique diagram showing the external 
appearance of an image processing device accord- 
ing to the present invention; 
Fig. 2 is a block diagram of the same embodiment; 
Fig. 3 is a flowchart showing a camera work opera- 
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tion in the same embodiment; 

Fig. 4 is an illustrative diagram of an operation in 

the same embodiment; 

Fig. 5 is an illustrative diagram of an operation in 
the same embodiment; s 
Fig. 6 is a flowchart of an operation for obtaining a 
smooth angle of view in the same and further 
embodiments; 

Fig. 7 is an illustrative diagram of the same opera- 
tion; 

Fig. 8 is an illustrative diagram of the same opera- 
tion; 

Fig. 9 is an illustrative diagram of the same opera- 
tion; 

Fig. 10 is an illustrative diagram of the same opera- 
tion; 

Fig. 11 is a flowchart of an operation for creating a 
river flow in the same and further embodiments; 
Fig. 12 is an illustrative diagram of the same opera- 
tion; 

Fig. 13 is an illustrative diagram of the same opera- 
tion; 

Fig. 14 is an illustrative diagram of the same opera- 
tion; 

Fig. 15 is a flowchart of an operation for moving a 
background, or the like, in the same and further 
embodiments; 

Fig. 1 6 is an illustrative diagram of the same opera- 
tion; 

Fig. 1 7 is an illustrative diagram of the same opera- 
tion; 

Fig. 1 8 is a flowchart of an operation relating to pol- 
ygon restriction in the same and further embodi- 
ments; 

Fig. 1 9 is an illustrative diagram of the same opera- 
tion; 

Fig. 20 is an illustrative diagram of the same opera- 
tion; 

Fig. 21 is a flowchart of an operation relating to field 
of view angle in the same and further embodi- 
ments; 

Fig. 22 is an illustrative diagram of conventional 
angle of view processing; 

Fig. 23 is an illustrative diagram of camera orienta- 
tion and field of view; 

Fig. 24 is an illustrative diagram of fields of view 
obtained by conventional angle of view processing; 
Fig. 25 is a diagram for the purpose of describing a 
conventional river flow; 

Fig. 26 is a diagram for the purpose of describing a 
conventional river flow; and 
Fig. 27 is an illustrative diagram of conventional 
movement of a background. 

BEST MODE FOR CARRYING OUT THE INVENTION 

Below, a best mode for carrying out the present 
invention is described on the basis of Fig. 1 - Fig. 5. Fig. 
1 shows an external view of this game device. In this 



drawing, numeral 1 indicates the main game device. 
This main game device 1 has a box-like shape, and it is 
provided with a display 1a comprising a CRT, projector, 
LCD device, plasma display, or the like, as a display 
means. On the front surface below this display 1 a, an 
operating panel 2 is provided. 

A speaker installation hole (omitted from drawing) is 
provided on the side of the display 1a, and a speaker 1 4 
is installed in this hole. 

A game processing board 10 is provided inside this 
main game device la. The display 1a, an operating 
device 11 in the operating panel 2, and the speaker 14 
are connected to the game processing board 10. By 
means of this structure, a player is able to play a game 
using the display 1a and the operating device 1 1 in the 
operating panel 2. 

This operating device 1 1 provided in the operating 
panel 2 is constituted by a joystick 2a and push buttons 
2b. The player can manipulate characters by means of 
this joystick 2a and push buttons 2b. 

Fig. 2 is a block diagram showing a game device in 
which the data processing device according to this 
embodiment is applied. This game device consists of a 
display 1 a, an operating device 1 1 located in an operat- 
ing panel 2, a game processing board 10, and a 
speaker 14. 

Operating signals input via a joystick 2a and push 
buttons 2b in this operating device 11 are input to the 
game processing board 10. The display 1a displays 
game images such as "Deru Chase l" ( for example, and 
a projector may be used in place of this display 1a. 

Game processing board 10 has a CPU (central 
processing unit) 101, and comprises, additionally, a 
ROM 102, a RAM 103, a sound device 104, an AMP 
(amplifier) 105, an input/output interface 106, a scroll 
data computing device 107, a co-processor (auxiliary 
processing unit) 108, a diagram data ROM 109, a 
geometrizer 110, a motion data ROM 111, a drawing 
device 112, a texture data ROM 113, a texture map 
RAM 114, a frame buffer 115, an image synthesizing 
device 116, and a D/A converter 117. 

The CPU 101 is connected via a bus line to: the 
ROM 102 wherein prescribed programs, image 
processing programs, and the like, are recorded, the 
RAM 1 03 which records data, the sound device 1 04, the 
input/output interface 106, the scroll data computing 
device 107, the co-processor 108. and the geometrizer 
1 10. The RAM 103 functions as a buffer, and, for exam- 
ple, various commands for the geometrizer (display 
object, and the like), and data required in various calcu- 
lations, are written into the RAM 103. 

The input/output interface 106 is connected to the 
operating device 1 1 , and it transfers operating signals in 
digital form from the joystick 2a and the like in the oper- 
ating device 11 to the CPU 101. The sound device 104 
is connected to the speaker 14 via the power amplifier 
105, where sound signals generated by the sound 
device 104 are power amplified and then passed to the 
speaker 104. 
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In this mode for implementation, on the basis of a 
program stored in the ROM 102, the CPU 101 reads 
operating signals from the operating device 1 1 , and dia- 
gram data from the diagram data ROM 109, or motion 
data from the motion data ROM 111, ("characters, such 5 
as self and enemy etc. " and "background, such as path 
of movement, terrain, sky and other structural objects"), 
and it conducts, at the least, action calculations (simula- 
tion), and special effects calculations. 

The action calculations simulate the movement of io 
characters in a virtual space in accordance with operat- 
ing signals given by the player via the operating device 
1 1 , and after the coordinate values in three-dimensional 
space have been determined, a conversion matrix for 
converting these coordinate values to a field of view 75 
coordinate series, and shape data (polygon data), are 
designated to the geometrizer 110. The diagram data 
ROM 109 is connected to the co-processor 108 and, 
consequently, predetermined diagram data is trans- 
ferred to the co-processor 108 (and the CPU 101). The 20 
co-processor 108 is devised such that it chiefly under- 
takes floating-point calculations. As a result, various 
decisions are executed by the co-processor 108 and the 
results of these decisions are relayed to the CPU 101, 
thereby enabling the calculation^ load on the CPU to 25 
be reduced. 

The geometrizer 110 is connected to the motion 
data ROM 1 1 1 and the drawing device 1 12. Shape data 
consisting of a plurality of polygons (three-dimensional 
data for characters, terrain, background and the like, 30 
comprising each vertex thereof) is previously stored in 
the motion data ROM 1 1 1, as described above, and this 
shape data is transferred to the geometrizer 110. The 
geometrizer 110 performs a perspective conversion of 
the specified shape data using the conversion matrix 35 
supplied by the CPU 101, thereby producing data con- 
verted from a coordinate system in a three-dimensional 
virtual space to a field of view coordinate system. The 
drawing device 112 applies texture to the converted 
field of view coordinate system shape data, and outputs 40 
it to the frame buffer 1 1 5. In order to conduct this texture 
application, the drawing device 1 12 is connected to the 
texture data ROM 113 and the texture map RAM 114, 
as well as being connected to the frame buffer 115. Inci- 
dentally, polygon data refers to data groups for the rela- 4S 
tive or absolute coordinates of each vertex in a polygon 
(chiefly, a three- or four-sided shape) consisting of a set 
of a plurality of vertices. The diagram data ROM 109 
stores relatively broad polygon data settings, which are 
sufficient for executing prescribed decisions. On the so 
other hand, the motion data ROM 1 1 1 stores more pre- 
cise polygon data settings, which relate to shapes con- 
stituting screens such as the characters, a truck or a 
background. 

The scroll data computing device 107 computes 55 
scroll screen data, such as text or the like (stored in the 
ROM 102), and the output signal from this computing 
device 107 and the output signal from the frame buffer 
115 are synthesized by the image synthesizing device 



116. This synthesized signal is converted from a digital 
signal to an analogue signal by the D/A converter 117, 
and is then input to the display 1a. Thereby, polygon 
screens (simulation results) for the character, truck, ter- 
rain (background) and the like stored temporarily in the 
frame buffer 115, and scroll screens for the required text 
information, are synthesized in a specified priority to 
generate the final frame image data. This image data is 
converted to an analogue signal by the D/A converter 
117 and sent to the display 1a, and the game image is 
displayed in real time. 

(Display processing for map (planar object)) 

Next, an operation for displaying a planar object 
(map) carrying text, diagrams or the like, in three-dimen- 
sional spatial coordinates, is described with reference to 
Fig. 3 - Fig. 5; 

Fig. 3 is a flowchart describing this operation. Fig. 4 
and Fig. 5 are illustrative diagrams of the same opera- 
tion. 

In the game device according to this mode for 
implementation, there is a scene where the hero char- 
acters move by riding on a truck. Fig. 4 and Fig. 5 are 
illustrative diagrams using this scene as an example. 

In Fig. 4. a truck 20 travels along a track 21 in the 
direction of the background 21. This state may be 
treated as though the truck 20 is in a stationary state 
and the background 23 and the like is coming towards it 
as indicated by the arrow in the drawing. Characters 24 
(25) are riding in the truck 20. The characters 24 (25) 
opens up a map 26. The curved line circling around the 
characters 24 (25) in Fig. 4 is the path travelled by the 
coordinates of the camera viewpoint, which is described 
below. There are six points on this curve, which are 
respectively labelled "1", "2", "3", "4", "5" and "6". The 
camera viewpoint moves in the order of these numbers. 
Specifically, centerd about the characters 24 (25), it 
moves upwards from below, and it turns to face down- 
wards. In Fig. 4, the camera viewpoint moves in an anti- 
clockwise direction. 

Fig. 5 shows six screens in Figs. 5(a), (b), (c), (d). 
(e) and (f), respectively, and the screens change in this 
order. Furthermore, Figs. 5 (a) - (f) correspond respec- 
tively to images taken at camera viewpoints 1 - 6 in Fig. 
4. 

Fig. 5(a) depicts the edge of the truck 20, where the 
camera is at viewpoint 1 , and it shows the track 21 , land 
surface 22, and mountains and the like in the back- 
ground 23 in the direction in which the truck 20 is travel- 
ling. At this camera viewpoint 1 , the characters 24 (25) 
are not shown. 

Fig. 5(b) depicts a rear view of the characters 24 
(25), where the camera is at viewpoint 2, and it shows 
the characters 24 (25), as well as the track 21 and the 
like. 

Fig. 5(c) depicts an upper rear view of the charac- 
ters 24 (25), where the camera is at viewpoint 3, and it 
portrays a full image of the truck 20 running along the 
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track 21. 

Fig. 5 (d) depicts a view based on viewpoint 4, 
which is shifted slightly forward of viewpoint 3, and here 
it can be seen that the characters 24 (25) have opened 
up the map 26. 5 

Fig. 5(e) depicts a view based on viewpoint 5, 
which is shifted slightly forwards and downwards from 
viewpoint 4, and here a more enlarged image of the 
map 26 is shown. 

Fig. 5(f) depicts a view based on viewpoint 6, which io 
is even closer to the map 26, and the map 26 is dis- 
played across the whole screen. 

Next, the operation based on the flowchart in Fig. 3 
is described. 

Firstly, the CPU 101 conducts game development 75 
processing in accordance with the programs stored in 
the ROM 102 (step 301, step 302; NO). 

Thereupon, when the CPU 101 determines that 
game processing is finished and one stage has been 
completed (step 302; YES), it moves to the viewpoint 20 
movement control steps. If the viewpoint coordinates 
are within prescribed values, this indicates, for example, 
a case where the characters proceed to a defined posi- 
tion in the game as a result of clearing a certain stage. 
To give a narrative example, this may be a case where ss 
the characters, having overcome various dangers to 
escape from a difficult situation, then climb into the truck 
once more in order to travel. In other words, it relates to 
scene changes. 

Firstly, the CPU 101 extracts the initial camera so 
viewpoint coordinates from the ROM 102 and stores 
them in a prescribed area of the RAM 103 (step 303). 

Thereupon, the CPU 101 conducts image process- 
ing of display data for the characters, background and 
the like, on the basis of the initial viewpoint coordinates 35 
recorded in the RAM 103 (step 304). 

Next, if the viewpoint coordinates recorded in the 
ROM 102 are within prescribed values (step 305; YES), 
the CPU 101 conducts image processing for displaying 
the map in a folded state (step 306). As shown in Fig. 4, 40 
as a result of the processing in step 306, the camera 
viewpoint coordinates assume viewpoint "1" located in 
front of the characters 24 (25). Furthermore, as shown 
in Fig. 5(a), the display screen viewed from this view- 
point "1 " comprises an edge portion of the truck 20, the as 
track 21, the land surface 22, and the background 23. 
These are displayed on the display 1a. 

Thereupon, the CPU 101 determines whether or 
not the final coordinate position of the camera has been 
reached (step 307). In the present case, it has clearly so 
not been reached (step 307; NO), and therefore the 
camera viewpoint coordinates stored in the prescribed 
area of the RAM 103 are updated (step 308), and the 
CPU 101 transfers once more to the processing in step 
304. 65 

If this processing (steps 304 - 308) is repeated, as 
shown in Fig. 4, the camera viewpoint coordinates will 
assume viewpoint "2" located behind the characters 24 
(25). As shown in Fig. 5(b), the display screen viewed 



from this viewpoint ("2") comprises the truck 20, the 
characters 24 (25) riding therein, the track 21, the land 
surface 22, and the background 23. These are dis- 
played on the display la. 

If this processing (steps 304 - 308) is further 
repeated, as shown in Fig. 4, the camera viewpoint 
coordinates will assume viewpoint "3" located behind 
and well above the characters 24 (25). As shown in Fig. 
5(c), the display screen viewed from this viewpoint ("3") 
comprises the truck 20, the characters 24 (25) riding 
therein, the track 21 , and the land surface 22. These are 
displayed on the display 1a in a similar state to a view 
from the sky. 

As this processing is repeated (steps 304 - 308), 
before the camera viewpoint coordinates reach "4" in 
Fig. 4, it is judged by the CPU 101 that the viewpoint 
coordinates stored in the prescribed area of the RAM 
103 have exceeded the prescribed values (step 305; 
NO). Thereupon, the CPU 101 executes image 
processing whereby the map 26 is displayed such that it 
gradually opens out from a folded state (step 309). In 
this processing, for example, the image is processed 
such that two points of the coordinates of the polygon 
forming the map are held as common points, and the 
other two points are updated every time this step is 
passed. Thereby, a map in the form of a book is dis- 
played as gradually opening out from a closed state. 
Accordingly, each time this step is passed, the map in 
the form of a book opens further, and when it reaches a 
fully opened state, updating of the polygon coordinates 
is discontinued. 

Similarly, if this processing (steps 304 - 305, 309, 
307, 308) is repeated, as shown in Fig. 4, the camera 
viewpoint coordinates will arrive at viewpoint "4" located 
diagonally behind the characters 24 (25). As shown in 
Fig. 5(d), the display screen viewed from this viewpoint 
("4") comprises an enlarged truck 20, the upper bodies 
of the characters 24 (25) riding therein, the opened map 
26 visible between these upper bodies, the track 21 , the 
land surface 22 and the background 23. These are dis- 
played on the display 1a. 

Again, if the CPU 101 repeats the processing in 
steps 304 - 305, 309, 307, 308, as shown in Fig. 4, the 
camera viewpoint coordinates will arrive at viewpoint "5" 
located directly above the characters 24 (25). As shown 
in Fig. 5(e), the display screen viewed from this view- 
point ("5") comprises a portion of the truck 20, the 
enlarged upper bodies of the characters 24 (25) riding 
therein, and an enlarged map 26 visible between the 
enlarged upper bodies. These are displayed on the dis- 
play la. 

If the CPU 101 further repeats the processing in 
steps 304 - 305, 309, 307, 308, as shown in Fig. 4. the 
camera viewpoint coordinates will arrive at viewpoint "6" 
located in front of the characters 24 (25). As shown in 
Fig. 5(f), the display screen viewed from this viewpoint 
("6") comprises the map 26 in an enlarged state which 
fills the entire screen of the display 1a. This is displayed 
on the display 1a. In this case, the CPU 101 judges that 
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the viewpoint coordinates have reached their final val- 
ues, (step 307; YES), and whilst the map 26 is being 
viewed, it executes pre-processing for the next stage 
(step 310), and shifts once more to game processing 
(step 301). 5 

Incidentally, information such as diagrams, text, fig- 
ures and the like required by the player are written onto 
the map 26 which is formed by a polygon. Therefore, the 
player does not need to call up a special map in order to 
obtain the required information. This information can be w 
obtained by making the characters on the game screen 
open out the map. Conventionally, necessary maps 
have been displayed, by a command or automatically, 
on a separate screen display in place of the game 
screen. is 

As described above, according to this mode for 
implementing the invention, since an operation is con- 
ducted whereby the map 26 is opened out by the char- 
acters on the game screen, and this map 26 is displayed 
on the display 1 a such that the player looks down onto it 20 
by means of camera work (movement of the viewpoint), 
it is possible to avoid a display which switches screens, 
and therefore interruptions to the flow of the game can 
be prevented. In other words, information required by 
the player, such as the player's status and position in the 25 
game as a whole, or the like, is written onto an object in 
the game space, and using camera work, this informa- 
tion is displayed in relation to the characters 24 (25) in 
the game, thereby making it possible to supply the 
required information and continue the game screen, 30 
simultaneously. Consequently, the player becomes fully 
involved with the characters as he or she experiences 
the adventure, without being made aware that he or she 
is playing a game, and thus his or her sense of immer- 
sion in the game increases. 35 

Incidentally, it is not necessary for the camera view- 
point position to circle completely around the charac- 
ters, but, for example, the display of the map 26 may halt 
in the area of viewpoint "5". Furthermore, the camera 
viewpoint position may follow points 1 - 6 in Fig. 4 in 40 
order, or it may follow them in reverse order, or alterna- 
tively, it may follow them in a non-consecutive order. The 
camera viewpoint position may move continuously 
between these points, or it may move onto points 1 - 6 
only. The camera viewpoint position may move within a 45 
vertical plane as shown in Fig. 4, or it may move within 
a horizontal plane. Moreover, the camera may pan by 
moving slowly left and right or up and down, or zoom, as 
in cinematic filming. In short, the screen display should 
be changed gradually to show information sources, so 
such as maps, explanations, and diagrams, which are 
continuously required, without interrupting the game 
screen. In doing this, the surrounding scenery and the 
characters should be included in the display. 

The foregoing described a truck ride scene as an ss 
example, but naturally it is not limited to moving scenes 
of this kind. Besides this, it may be applied to cases 
where a stage has been cleared, or where the charac- 
ters are taking a rest, or where they are selecting equip- 



ment, for instance. In short, it may be applied to any 
scene where a screen change or temporary interruption 
is required. 

(Operation for determining viewpoint) 

Next, an operation for determining the line of sight 
in this game device is described with reference to Fig. 6 
- Fig. 10. 

Here, Fig. 6 is a flowchart of this operation. 
Fig. 7 - Fig. 9 are illustrative diagrams of this opera- 
tion. 

Fig. 10 is a diagram for describing a method of 
determining the line of sight in accordance with the cur- 
vature of a curve. 

As in the foregoing, the description below takes as 
an example a case where the characters travel by riding 
on a truck 20. During processing of the game program, 
the CPU 101 initiates the flowchart shown in Fig. 6, 
when the truck 20 in which the hero characters are rid- 
ing enters a curve. 

Upon initiating this flowchart, the CPU 101 reads 
the current point q20 coordinates of the truck 20 (step 
401). In other words, as shown in Fig. 7(a), the current 
point q20 coordinates (X, Y, 2) of the truck 20 are input 
to the CPU 101. 

Next, in accordance with a predetermined distance 
setting a, the CPU 101 inputs the coordinates of a point 
q21 on the track to the front of the truck 20 and sepa- 
rated from the current coordinates of the truck 20 by the 
distance setting a (step 402). Here, the symbol a is a 
distance setting used to obtain point coordinates 
located at a prescribed distance in front of and behind 
the current point of the truck 20, and it is stored in a pre- 
scribed area of the RAM 103, for example. The CPU 
101 inputs coordinates in front of and behind the truck 
20 on the basis of this distance setting a. 

Next, the CPU 101 inputs the coordinates of a point 
q22 separated from the current coordinates of the truck 
20 by the distance setting a to the rear of the truck 20 
(step 403). Thereby, the coordinates of points (posi- 
tions) q21 and q22 located equidistantly in front of and 
behind the current coordinates of the truck 20 are input 
to the CPU 101. 

Next, the CPU 1 01 conducts calculational process- 
ing to link the coordinates obtained in steps 402 and 
403 by a straight line (step 404). As shown in Fig. 7(b), 
this corresponds to a process linking point q21 and 
point q22 by means of the straight line N. 

Since the coordinates of points q21 and q22 are 
already known, the CPU 101 can find the length of the 
straight line N in the calculation in step 404. The angle 
of the curve can be determined from the length of this 
straight line N. For example, as shown in Fig. 8(a), the 
straight line Na between points q21 and q22 is long 
when the curve has an obtuse angle. When the points 
q20, q21 and q22 lie in a straight line, the length of 
straight line Na takes its maximum value of 2 a. On the 
other hand, as shown in Fig. 8(b), as the angle of the 
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curve approaches an acute angle, the straight line Nb 
linking points q21 and q22 becomes shorter. In other 
words, when q a > q b, Na > Nb. The length of the 
straight line N(90°) when q = 90° can be calculated in 
advance (N 2 = 2 a 2 ) , so this N(90°) value can serve s 
as a reference for judging whether a curve is obtuse or 
acute. 

Thus, the CPU 101 determines the value for the 
distance N of the straight line obtained in step 404 (step 
405). Here, if the straight line Na is long, as shown in io 
Fig. 8(a), the CPU 101 judges that the curve has an 
obtuse angle and it sets the distance setting a to a 
standard value and stores it in the RAM 103 (step 407). 
On the other hand, if the straight line Na is short, as 
shown in Fig. 8(b), the CPU 101 judges that the curve 75 
has an acute angle and it sets the distance setting a to 
a small value and stores it in the RAM 103 (step 406). 
The distance setting a is switched in this way, according 
to whether the angle of the curve is obtuse or acute, in 
order that the camera orientation changes naturally 20 
through curves, even in places where the track 21 of the 
truck 20 curves sharply. 

The CPU 101 then adapts the straight line found in 
step 404 to the current point q20 by moving it to a paral- 
lel position, as shown in Fig. 7(b), and this is stored in a 25 
prescribed area of the RAM 103, for example, as a cam- 
era orientation F (step 408). 

By repeating these processing steps 401 - 408, it is 
possible to change the camera line of sight smoothly 
through a curve. For example, as shown in Fig. 9, at so 
camera orientation F10 at point q10, the field of view is 
G10. At point q20, the camera orientation will be F20 
derived from points q21 and q22 ( and the field of view 
will be G20. Furthermore, at point q30, the camera ori- 
entation will be F30 derived from points q31 and q32, 35 
and the field of view will be G30. As Fig. 9 illustrates, the 
fields of view overlap partially with each other as the line 
of sight changes. In the prior art example in Fig. 24, 
there are virtually no overlapping portions in the fields of 
view, so there is a large swing between the screens dis- ao 
played each time the viewpoint changes. It can be seen 
that, according to the processing in this mode tor imple- 
mentation, the field of view G moves smoothly, as 
shown in Fig. 9. 

Since the distance setting a can be varied in as 
response to the angle, the interval according to distance 
setting a can be made large when the curve is gentle, as 
shown in Fig. 10(a), for example, and it can be made 
small when the curve is sharp, as shown in Fig. 10(b). 
With regard to the number of times the calculation of so 
straight line N is repeated, in Fig. 10(a), this number is 
relatively small, and in Fig. 10(b), it is relatively large. 
Therefore, by varying the distance setting a according to 
the angle, optimal processing can be conducted whilst 
reducing the load on the CPU 101. ss 

The camera line of sight can be made to follow the 
curve more closely, the smaller the value given to dis- 
tance setting a, but this increases the load on the CPU 
101 . On the other hand, as the value of a is raised, the 



movement of the camera line of sight becomes less and 
less smooth, but the load on the CPU 101 is reduced. 
Therefore, these two conditions are taken into consider- 
ation when actually determining the value of a. If the 
tightest curve is known in advance, then a minimum 
value for a that is not unfeasibly small is determined 
using this curve as a reference, and as the curves 
become more gentle, a is gradually increased. For 
example, a fixed increment D a should be set and this is 
multiplied as nx D a (where n is an integer), as the 
radius of the curve increases. If a is set to an extremely 
small value, then this will yield the direction of the tan- 
gent to the curve at a certain point (for example, point q 
20). However, in digital processing, curves are dis- 
played in a discontinuous rather than a continuous form, 
so there is no need to reduce the spacing beyond this. 

According to this mode for implementation, since 
two points on the track in front of and behind the truck 
are selected and the camera line of sight is determined 
on the basis of these two points, it is possible to create 
natural movement, without the viewpoint (camera orien- 
tation F) moving by a large amount when passing 
through curves. Furthermore, the weight of objects that 
is felt when passing through curves can also be repre- 
sented. Moreover, since the direction of the viewpoint is 
determined by means of points in front of and behind 
the current coordinate point, it is possible to respond 
even when the travel of the viewpoint is reversed. In 
addition, since the spacing between the two points can 
be adjusted, the range of oscillation in the viewpoint can 
also be adjusted. Furthermore, since the angle of the 
curve can be determined from the straight line N linking 
the two points, it is possible to respond directly to the 
motion data. 

The processing described above is not applicable 
solely to the case of a truck running along a track. It can 
also be applied, for example, to the case of a car going 
around a curve, or an aeroplane climbing or descend- 
ing. Furthermore, it can also be applied when the curve 
is not necessarily required to be smooth, for instance, 
on a course formed by a plurality of connected straight 
lines. In short, the processing described above is appli- 
cable in cases where the reference direction for the 
screen display is determined according to fixed rules. 

Furthermore, in determining the reference direction 
for the screen display, a different method may be used, 
for instance, determining the camera orientation on the 
basis of the straight line angle information, without mov- 
ing the straight line to a parallel position. Alternatively, 
the processing may be conducted on the basis of direc- 
tion information (angle information) previously estab- 
lished in relation to the curve, without needing to derive 
straight lines. 

Furthermore, the points from which straight line N is 
derived need not necessarily be points on either side of 
a moving object on a track, and they may be based on 
current positional information for the moving object and 
positional information for points through which the mov- 
ing object will subsequently pass (for example, a point 
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slightly ahead and a point a long way ahead). 

(Operation for coordinate processing to represent a 
river flow) 

5 

Fig. 11 is a flowchart for describing the flow of a 
river according to this mode for implementation. Fig. 12 
is an illustrative diagram for describing the relationship 
between a polygon and various coordinates. Fig. 13 is 
an illustrative diagram of a texture coordinates system: w 
the horizontal axis is taken as u, and the vertical axis, as 
v. An image representing a river is displayed by means 
of pluralities of polygons linked in both directions u and 
v. Fig. 14 is an illustrative diagram showing a river flow 
represented by means of this process. 75 

The river flow is represented by the following 
method. As shown in Fig. 12, a section corresponding to 
a river is constituted by a polygon PGM wherein a plu- 
rality of polygons PG1, PG2, ... are linked successively. 
Thereupon, texture with the appearance of a water flow 20 

is applied respectively to each polygon PG1, PG2 

These texture coordinates are caused to change in the 
direction of the river flow as time passes. By this means, 
a river flow can be represented. 

In this mode for implementation, as shown in Fig. 25 
12, curves K1, K2, ... (same number as polygons in 
direction of chain) which act as references for the tex- 
ture coordinates are prepared for each polygon PG1, 

PG2 The polygons PG1, PG2, ... in this diagram 

show one portion of a plurality of polygons linked longi- 30 
tudinally and laterally. Consequently, polygons not 
shown in the drawings are linked in the lateral direction 
of polygons PG1 and PG2, also. 

Here, it is assumed that the CPU 101 has trans- 
ferred to processing for representing a river flow. There- 35 
upon, the CPU 101 processes the flowchart in Fig. 11. 
Firstly, the CPU 101 inputs the reference vector K1 act- 
ing as a texture coordinate reference prepared for each 
polygon PG1 (step 501). A reference vector is deter- 
mined for each polygon chain in the lateral direction 40 
(direction perpendicular to that in which the river is flow- 
ing) on the basis of a predetermined river course 
(curve). For example, reference vector K1 is set for the 
polygon chain including polygon PG1, and reference 
vector K2 is set for the polygon chain including polygon 45 
PG2, respectively. TTie reference vectors represent the 
flow of the river. 

Next, the CPU 101 calculates texture coordinates 
using this reference vector K1 (step 502). This calcula- 
tion is made as follows, for example. In polygon PG1 in so 
Fig. 12, L1, L3 and L4 are taken as parallel segments to 
reference vector K1 , and L2, L5 and L6 are taken as 
perpendicular segments to reference vector K1. There- 
upon, the texture coordinates for vertices p1 , p2, p3, p4 
of polygon PG1 are found from: ss 

pi = (u, v) 

p2 = (pl.u + L2 , p1.v+ L3) 



D3 = (p2.u + L4,p2.v + L5) 

p4=(p1.u + L6,plJV + L1) . 

Here, pl.u indicates the in component of p1, and pl.v 
indicates the v component of p1. By means of this con- 
version, the texture coordinates and the polygon PG1 , 
PG2, ... coordinates can be matched to each other. 

After conducting this calculation, the CPU 101 
determines whether or not all the polygons have been 
completed (step 503). 

Here, since they are not yet completed (step 503; 
NO), the polygon PG subscript number is updated (step 
504) so that calculation can be made for the next poly- 
gon PG, and the CPU 101 returns again to the process- 
ing in step 501. 

By causing each texture to move according to pre- 
determined reference vectors by means of the process- 
ing in steps 501 - 504, an image representing a river 
flow can be obtained. 

In this mode for implementation, when a represen- 
tation of flowing water is conducted by means of texture- 
mapped polygons, as shown in Fig. 14, the water is rep- 
resented as flowing along the course of a river without 
any changes in the density of the textures 61 , 62, ... on 

the polygons 51, 52 and therefore a natural water 

flow can be reproduced. 

In other words, by projecting mapping data 
expressed as texture coordinates onto polygons show- 
ing a river flow on the basis of reference vectors follow- 
ing the river flow, the textures for representing the river 
flow can be changed in shape as appropriate to match 
the shape of the river flow. Therefore, a natural repre- 
sentation of a river flow is possible. 

The reference vectors K1, K2, ... correspond indi- 
vidually to the polygons PG1 , PG2 A reference vec- 
tor acts as the reference for the river flow in the 
corresponding polygon. In some cases, the reference 
vector may be defined by the shape of the polygon, for 
example, as a line perpendicular to the sides, or as a 
line linking the midpoints of the sides. Furthermore, if 
the river is flowing in a predetermined direction, the ref- 
erence vector may be defined for each polygon on the 
basis of the curve representing this flow. 

The conversion formulae between the texture coor- 
dinates and the polygons are not limited to the example 
given above, and other conversion formulae may be 
used. For example, the conversion may be based on the 
angle formed by a side of the polygon and the reference 
vector. 

The example described above concerned a case 
where a river flow is represented. This mode for imple- 
mentation can be applied to the representation of other 
flowing images. 

(Operation for screen movement processing) 

Fig. 15 is a flowchart for describing screen move- 
ment processing in this mode for implementation. Fig. 
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16 is an illustrative diagram of this screen movement 
processing. Fig. 17 is also an illustrative diagram of this 
screen movement processing. 

In this mode for implementation, a display is cre- 
ated using interactive computer graphics. When Z-buff- s 
ering is used in this display to erase hidden surfaces, an 
object which is of the maximum size within the Z-direc- 
tion display range is prepared. Furthermore, when Z- 
sorting is used in this display, an object which is suffi- 
ciently large compared to the other objects is prepared. io 

For example, when using Z-buffering, as shown in 
Fig. 17(a), since the largest object within the display 
range G from viewpoint 69 is the object 71 , then this is 
set as a movable object. The object 71 is, for example, 
a background object such as a mountain peak, a celes- 75 
tial body, the sky, or the like. The numerals 72, 73, 74, ... 
represent various objects in front of the background. 

Firstly, the CPU 101 executes game development 
processing (step 601), and if there is no movement in 
the viewpoint (step 602; NO), it returns again to the 20 
processing in step 601. At this point, it is in a state as 
shown in Fig. 17(a), for example. 

Thereupon, if the viewpoint 69 moves as shown in 
Fig. 17(b), for example, (step 602; YES), the CPU 101 
inputs the current viewpoint coordinates after the move- 2s 
ment (step 603). 

The CPU 101 then extracts the preceding viewpoint 
coordinates input on the previous occasion, from a pre- 
scribed area of the RAM 103, in addition to which it 
writes the new coordinates into a prescribed area of the 30 
RAM 103 and conducts a subtraction calculation with 
the newly input coordinates (step 604). 

If the CPU 101 judges that the calculation result is 
not above a prescribed value (step 605: NO), then rt 
returns to the processing in step 601 . This is because, 35 
when the distance moved is not very large, there is no 
considerable change in the appearance of the object 71 
in the distance. The threshold value in this step 601 is 
set on the basis of the distance to the object 71, within 
a range such that the player does not receive an unnat- 40 
ural impression. 

Furthermore, when the CPU 101 judges that this 
calculation result is above the prescribed value (step 
605; YES), it reads the coordinates of the prescribed 
object 71 (step 606). 4S 

Thereupon, the CPU 101 changes the coordinates 
of the object 71 on the basis of the aforementioned cal- 
culation result (step 607). For example, it moves the 
object 71 away through a distance equal to that by 
which the viewpoint 69 has approached the object 71 . In so 
this case, object 71 and object 72 move apart and there 
may be a discontinuity between these two objects, but 
since object 71 is in the extreme distance, no particular 
unnatural impression is created thereby. 

The CPU 101 then stores these coordinates in a 55 
prescribed area of the RAM 103 (step 608), whereupon 
it transfers again to the processing in step 601 . 

Thus, in this mode for implementation, as shown in 
Fig. 17(b), if the viewpoint 69 moves, the background 70 



of course moves correspondingly, and the object 71 
also moves. Therefore, it is possible to prevent changes 
in appearance as the viewpoint moves. 

In other words, no unnatural impression is created, 
even when representing an object at an infinite dis- 
tance, such as a celestial body or the sky, or a very large 
object, or an image that has no distance value, such as 
an optical phenomenon. This method is particularly 
beneficial in cases where the Z-buffer for representing 
the depth of objects is expressed in integers in order to 
increase the processing speed. Conventionally, in 
cases of this kind, special processing for representing 
the depth of objects at irrlinite distances has been 
required, but according to this mode for implementation, 
such processing becomes unnecessary. This eases 
restrictions on hardware. 

As shown in Fig. 16, a sphere 76 of the maximum 
size within the display range, bearing a representation 
of a starry sky, or the like, may be created, the viewpoint 
69 being positioned at the center point of this sphere 76, 
and said center point being moved in accordance with 
movement in the viewpoint. Thus, the position of this 
sphere 76 changes with movement in the viewpoint 69. 
When Z-buffering is used, the radius of this sphere 76 is 
the maximum size in the Z-direction display range. 
When Z-sorting is used, a celestial sphere or the like at 
an infinite distance is represented by preparing an 
object of sufficiently large size compared to the other 
objects, and moving the position of this object through 
the same distance as the movement in the viewpoint. A 
infinitely distant background image of cylindrical shape 
may also be used in place of the sphere 76. 

By this means, even H, for example, the position of 
viewpoint 69 does not change, but the character looks 
up, or turns around, an appropriate background, such 
as a starry sky, or the like, corresponding to this orienta- 
tion, can always be obtained. 

Conventionally, backgrounds of this type have been 
created by preparing background screens which are 
pasted onto the display screen, but this appears unnat- 
ural because the display does not change, whatever the 
direction of view. 

(Description of polygon number restriction) 

Fig. 18 is a flowchart of an operation for polygon 
number restriction according to this mode for implemen- 
tation. Fig. 19 is an illustrative diagram of this mode for 
implementation. Fig. 20 is also an illustrative diagram of 
this mode for implementation. 

In this mode for implementation, firstly, limit values 
are applied respectively to the polygons forming the 
characters 24, 25, the polygons forming the enemies 
and the like, and the polygons forming the background 
and the like. As shown in Fig. 19, in this mode for imple- 
mentation, there are provided a buffer 81 wherein the 
limit number R1 for the polygons forming the characters 
24, 25 is set, a buffer 82 wherein the limit number R2 for 
the polygons forming the enemies and the like is set, 
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and a buffer 83 wherein the limit number R3 for the pol- 
ygons forming the background and the like is set. These 
buffers 81 - 83 may be provided in the RAM 103, for 
example. The limit numbers R1 - R3 are stored in the 
ROM 1 02, and are read to the buffers 81 - 83 when the 5 
operation is initiated. 

Next, the operation is described on the basis of the 
flowchart in Fig. 18. 

The CPU 101 executes game development 
processing (step 701), whereupon it reads the polygon 10 
limit number R1 from buffer 81 (step 702). Next, the 
CPU 101 allocates this to the necessary characters 
(step 703) and then generates characters such that this 
allocated polygon number is not exceeded (step 704). 

Thereupon, the CPU 101 reads the polygon limit is 
number R3 from buffer 83 (step 705), and then allocates 
this to the necessary background (step 706). The CPU 

101 generates a background such that this allocated 
polygon number is not exceeded (step 707). 

The CPU 101 then determines whether or not any 20 
enemies appear (step 708). If no enemies appear (step 
708; NO), it transfers back to the processing in step 701 . 
By executing the processing in steps 701 - 708 in this 
way, a display screen such as that in Fig. 20(a), for 
example, is created. In Fig. 20(a), a truck 20, characters 25 
24, 25 riding therein, a track 21, a land surface 22, and 
a background 23, are represented. 

Furthermore, if enemies do appear (step 708; 
YES), the CPU 101 moves again to the processing in 
step 709. At this step, the CPU 101 reads the polygon 30 
limit number R2 from buffer 82 (step 709), whereupon it 
allocates this to the necessary enemies (step 710). The 
CPU 101 then generates enemies such that this allo- 
cated polygon number is not exceeded (step 711). 
When these steps 708 - 711 are executed, a display 35 
screen such as that in Fig. 20(b), for example, is cre- 
ated. In Fig. 20(b), a truck 20, characters 24, 25 riding 
therein, a track 21, a land surface 22, a background 23 
and the like, and an enemy 27 aiming a pistol from the 
side, are represented. 40 

Conventionally, since the overall number of poly- 
gons in the background 23 and the like is controlled, 
there has been a problem in that polygons in the back- 
ground 23 are lost when a large number of enemies 27 
appear. However, according to the present mode for 45 
implementation, since the respective upper limits for the 
enemy 27 and the background 23 are controlled individ- 
ually, there is no loss of background 23 polygons, even 
if the enemy 27 appears in large numbers. 

so 

(Description of field of view angle) 

Fig. 21 is a flowchart for describing the operation of 
altering the field of view angle. 

In Fig. 21, the CPU 101 executes a game develop- ss 
ment operation on the basis of a program from the ROM 

1 02 (step 80 1 ) . The field of view angle changes with the 
game development, in a predetermined manner. The 
CPU 101 assesses the field of view angle from the 



game development (step 802). If the truck 20 is travel- 
ling across a plain, for example, during the game 
processing, and the field of view angle is large (step 
802; large), then the CPU 101 sets the field of view 
angle to large (step 803). If it is travelling between hills 
or buildings, or the like, for example, during the game 
processing, and the field of view angle is medium (step 
802; medium), then the CPU 101 sets the field of view 
angle to medium (step 804). Furthermore, if it is travel- 
ling through a tunnel, for example, during the game 
processing, and the field of view angle is small (step 
802; small), then the CPU 101 sets the field of view 
angle to small (step 805). 

Consequently, at the next step 806, the CPU 101 
reads the set field of view angle and executes field of 
view angle processing (step 806). 

Thereby, for example, when the truck 20 is travelling 
through a tunnel, the field of view angle is set extremely 
small and the far distance is displayed. When it is travel- 
ling through hills or the like, the field of view is set to a 
medium angle. And when it is travelling across a plain or 
the like, the field of view is set to a large angle. Changes 
in the field of view angle of this kind correspond to sight 
characteristics in humans, and therefore it is possible to 
provide an extremely realistic game screen. 

Claims 

1. In an image processing device which causes a 
moving object composed in three-dimensional spa- 
tial coordinates to move, and generates viewpoint 
images whereby said moving object is viewed from 
prescribed viewpoints, the image processing device 
comprising: 

information representing object generating 
means for composing an information repre- 
senting object whereby information relating to 
said moving object is represented in three- 
dimensional spatial coordinates. 

2. An image processing device according to claim 1, 
wherein said information representing object gener- 
ating means composes a planar object indicating 
the position of said moving object as said informa- 
tion representing object. 

3. An image processing device according to claim 2, 
wherein said information representing object gener- 
ating means causes said planar object to change 
from a folded state to an opened state. 

4. An image processing device according to any one 
of claims 1 to 3, further comprising it comprises 
viewpoint moving means for moving said viewpoint 
such that, when said information representing 
object has been composed, both said moving 
object and said information representing object are 
displayed. 



14 



27 



EP0 782 104 A1 



28 



5. An image processing device according to claim 4, 
wherein said viewpoint moving means, further, 
moves said viewpoint towards said information rep- 
resenting object. 

6. An image processing device according to any one 
of claims 1 to 5. further comprising display means 
for displaying said generated viewpoint image. 

7. A game device which conducts a game whilst caus- 
ing said moving object to move in three-dimen- 
sional spatial coordinates, characterized in that it 
comprises an image processing device according 
to any one of claims 1 to 6. 

8. In an image processing method which generates 
viewpoint images whereby a moving object com- 
posed in three-dimensional spatial coordinates and 
an information representing object which repre- 
sents information relating to this moving object are 
viewed from prescribed viewpoints, the image 
processing method comprising: 

a first step whereby said viewpoint is moved to 
a position displaying said moving object only; 
a second step whereby said viewpoint is 
moved to a position displaying both said mov- 
ing object and said information representing 
object; and 

a third step whereby said viewpoint is moved 
towards said information representing object 
such that said information representing object 
is displayed as a larger image. 

9. An image processing device comprising: 

view axis determining means for determining a 
view axis direction on the basis of: 

a moving object composed in three-dimen- 
sional spatial coordinates; 
a observation point located on the path 
through which said moving object is to 
pass subsequently; 

a transit point located on the path through 
which said moving object has already 
passed; and 

positional information for said observation 
point and positional information for said 
transit point 

10. An image processing device according to claim 9, 
wherein said view axis determining means deter- 
mines the view axis direction on the basis of posi- 
tional information for said observation point and 
said transit point located equidistantly in front of 
and behind said moving object. 

11. An image processing device according to claim 10, 



wherein, if said moving object moves along a curve, 
said viewpoint determining means changes the dis- 
tance from said moving object to said observation 
point and said transit point, respectively, in accord- 
ance with the properties of the curve. 

12. An image processing device according to claim 10 
or 1 1 , further comprising display means for display- 
ing said generated viewpoint image. 
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13. A game device which conducts a game whilst caus- 
ing said moving object to move in three-dimen- 
sional spatial coordinates, characterized in that it 
comprises an image processing device according 
to any one of claims 9 to 12. 

14. In an image processing device which causes a 
moving object composed in three-dimensional spa- 
tial coordinates to move, and generates viewpoint 
images whereby said moving object is viewed from 
prescribed viewpoints, the image processing device 
comprising: 

viewpoint determining means for smoothly 
changing the line of sight centerd on said view- 
point in accordance with the path of said mov- 
ing object. 

15. An image processing device according to claim 14, 
wherein said viewpoint determining means deter- 
mines the direction of the line of sight centerd on 
said viewpoint, on the basis of coordinates on the 
path in front of and behind said moving object. 



35 16. An image processing device according to claim 15, 
wherein said viewpoint determining means calcu- 
lates two sets of coordinates located equidistantly 
in front of and behind said moving object, and takes 
the straight line joining these coordinates as the 
direction of said line of sight 

17. An image processing device according to claim 15 
or 16 wherein, if said moving object moves along a 
curve, said viewpoint determining means changes 
the distance from said moving object to the coordi- 
nates in front of and behind it, respectively, in 
accordance with the properties of the curve. 

18. An image processing device according to any one 
of claims 14 to 17, further comprising display 
means for displaying said generated viewpoint 
image. 

19. A game device which conducts a game whilst caus- 
ing said moving object to move in three-dimen- 
sional spatial coordinates, characterized in that it 
comprises an image processing device according 
to any one of claims 14 to 18. 
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20. In an image processing method which causes a 
moving object composed in three-dimensional spa- 
tial coordinates to move, and generates viewpoint 
images seen from the viewpoint of said moving 
object, the image processing method comprising: 

a first step whereby the position of said moving 
object is read; 

a second step whereby a first point is set on the 
path to the front of said moving object at a pre- 
determined distance from the position thereof; 
a third step whereby a second point is set on 
the path to the rear of said moving object at a 
predetermined distance from the position 
thereof; and 

a fourth step whereby the direction of the line of 
sight from said viewpoint is determined on the 
basis of the line joining said first point and said 
second point. 

21. In an image processing device which generates 
prescribed images by applying texture respectively 
to linked pluralities of polygons, the image process- 
ing device comprising: 

coordinate processing means for determining a 
reference vector for each mutually linked plural- 
ity of polygons and for causing said texture to 
move in the direction of said reference vector, 
said moved texture being applied to said poly- 
gons. 

22. In an image processing device which generates 
prescribed images by applying texture respectively 
to linked pluralities of polygons, the image process- 
ing device comprising: 

coordinate processing means for determining 
reference vectors for each longitudinal or lat- 
eral polygon chain in the longitudinally and lat- 
erally linked pluralities of polygons, and for 
causing said texture to move in the direction of 
this reference vector, without any deformation 
of said texture. 

23. An image processing device according to claim 21 
or 22, wherein said coordinate processing means 
determines said reference vectors on the basis of a 
predetermined curve. 

24. An image processing device according to claim 23, 
wherein the reference vectors for each of said plu- 
ralities of polygons are continuous and said texture 
corresponds to a flow along said curve. 

25. An image processing device according to any one 
of claims 21 to 24, characterized in that it comprises 
display means for displaying said generated image. 



26. In an image processing method which generates 
prescribed images by applying texture respectively 
to linked pluralities of polygons, the image process- 
ing method comprising: 

5 

a first step whereby a reference vector is deter- 
mined for each mutually linked plurality of poly- 
gons; 

a second step whereby said texture is caused 
io to move in the direction of said reference vec- 

tor; and 

a third step whereby said moved texture is 
applied to said polygons. 

75 27. In an image processing device which causes a 
moving object to move in three-dimensional spatial 
coordinates, and generates viewpoint images seen 
from a viewpoint at a position of this moving object, 
the image processing device comprising: 

20 

movement processing means for causing a 
background image representing a distant back- 
ground to move with a movement of said view- 
point. 

25 

28. An image processing device according to claim 27, 
wherein said background image forms a cylindrical 
shape or a spherical shape. 

30 29. An image processing device according to claim 27 
or 28, characterized in that it comprises display 
means for displaying said generated image. 

30. A game device which conducts a game whilst caus- 
35 ing said moving object to move in three-dimen- 
sional spatial coordinates, wherein it comprises an 
image processing device according to any one of 
claims 27 to 29. 



40 31. In an image processing method which causes a 
moving object to move in three-dimensional spatial 
coordinates, and generates viewpoint images seen 
from a viewpoint at a position of this moving object, 
the image processing method comprising: 

45 

a first step whereby the amount of movement of 
said moving object is found; and 
a second step whereby a background image 
representing a distant background is caused to 
so move on the basis of said amount of move- 

ment. 

32. In an image processing device which causes a 
moving object composed in three-dimensional spa- 
55 tial coordinates to move, and generates viewpoint 
images seen from a viewpoint at a position of this 
moving object using polygons, the image process- 
ing device comprising: 
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polygon number controlling means for classify- 
ing the polygons forming said viewpoint image 
into a plurality of polygon groups, and for con- 
trolling the number of polygons displayed such 
that, at each group, it is at or below a predeter- 5 
mined maximum number of polygons dis- 
played. 

33. An image processing device according to claim 32, 
wherein said polygon number controlling means io 
classified the polygons forming said viewpoint 
image into at least polygon group representing the 
background and other group. 

34. An image processing device according to claim 32 75 
or 33, characterized in that it comprises display 
means for displaying said generated viewpoint 
image. 

35. A game device which conducts a game whilst caus- 20 
ing said moving object to move in three-dimen- 
sional spatial coordinates, wherein it comprises an 
image processing device according to any one of 
claims 32 to 34. 

25 

36. In an image processing method which causes a 
moving object composed in three-dimensional spa- 
tial coordinates to move, and generates viewpoint 
images seen from a viewpoint at a position of this 
moving object using polygons, the image process- 30 
ing method comprising: 



39. An image processing device according to claim 37 
or 38, characterized in that it comprises display 
means for displaying said generated viewpoint 
image. 

40. A game device which conducts a game whilst caus- 
ing said moving object to move in three-dimen- 
sional spatial coordinates, characterized in that it 
comprises an image processing device according 
to any one of claims 37 to 39. 

41. In an image processing method which causes a 
moving object composed in three-dimensional spa- 
tial coordinates to move, and generates viewpoint 
images seen from a viewpoint at a position of this 
moving object, an image processing method com- 
prises: 

a first step whereby conditions relating to 
objects in front of said moving object are inves- 
tigated; and 

a second step whereby the field of view is 
broadened when no object is present, and the 
field of view is narrowed when an object is 
present. 

42. A storage medium wherein procedures for imple- 
menting a method according to any of claim 8, 
claim 20, claim 26, claim 31, claim 36, or claim 41 , 
in a processing device, are recorded. 



a first step whereby the polygons forming said 
viewpoint image are classified into a plurality of 
polygon groups and a maximum number for the 35 
number of polygons displayed is determined at 
each of said groups; and 
a second step whereby the number of polygons 
displayed is controlled at each of said group 
within a range not exceeding said maximum 40 
display number. 



37. In an image processing device which causes a 
moving object composed in three-dimensional spa- 
tial coordinates to move, and generates viewpoint as 
images seen from a viewpoint at a position of this 
moving object, 

the image processing device characterized 
in that it comprises field of view changing means for 
changing the field of view of said viewpoint image in so 
accordance with the conditions in a direction of 
movement. 



38. An image processing device according to claim 37, 
where said field of view changing means broadens 55 
the field of view when no object is present in front of 
said moving object, and narrows the field of view 
when an object is present. 
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